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A CONTINUOUS TIME STOCHASTIC MODEL FOR BIOLOGICAL 

NEURAL NETS 

LEONARDO NAGAMI COREGLIANO 


Abstract. We propose a new stochastic model for biological neural nets which is a continuous 
time version of the model proposed by Galves and Locherbach in [1]. We also show how to 
computationally simulate such model for easy neuron potential decays and probability functions 
and characterize when the model has a finite time of death almost surely. 


1. Introduction 

Based on a stochastic model for biological neural nets proposed by Galves and Locherbach 
in [1] and on a specific algorithm for simulating such model, we propose a model on continuous 
time. Formally, the model is actually still discrete but generates times of neuron discharges 
which could be interpreted as a boolean stochastic process on continuous time. 

One common approach to define continuous time models is to consider stochastic differential 
equations, but the approach considered here is more of an algorithmic oriented approach and 
throughout this work we focused on producing a model that can be efficiently simulated. 

Since the nature of the model is algorithmic, we choose to first present the model informally 
with a more intuitive and constructive approach and only formalize it on the final section. 

Also in the final section we present a characterization of when the system dies almost surely, 
i.e., when there is a time to G M+ such that there are no neuron discharges after to. 

2. Discrete time model 

In this section we present the discrete time model proposed by Galves and Locherbach [1] 
and algorithms to simulate it. Such algorithms will provide a useful insight on how to define an 
analogous continuous time model. 

For simplicity, we will consider in this section the model with a finite set of neurons and with 
no potential decay, but we stress that Galves and Locherbach did study the case of a countable 
set of neurons and with potential decays much more general than the ones we will consider in 
the continuous time model. 

2.1. The model. We first assume fixed a finite set I of neurons, a family of potential probability 
functions {ipi)i^i. For every i G /, the function : M —[0,1] maps the potential of neuron i to 
the probability that it will fire at that time. For every i,j G /, we also assume fixed Wi^j G M, 
which gives the influence that a discharge of neuron i has on neuron j. 

The model consists of a stochastic chain (W)tez taking values in {0,1}^ and an auxiliary 
chain {Ut)t& taking values in M^. For each neuron i G I, and each time t G Z, the value Xt{i) 
will be 1 if neuron i fires at time t and 0 otherwise. Furthermore, each neuron i G / will have 
an internal potential at time t G Z given by Ut{i). 

We define now the filtration 

Xt = (^[{Xs : s G Z, s ^ t}], t G Z, 
and, for every time t G Z and neuron i £ I, we let 

L] = sup{s ^ t : Xs{i) = 1} 
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be the Ft-measurable time of the last discharge of neuron i up to time time t. The potential of 
neuron i at time t is then defined as the Tt-measurable random variable 

C/t(i)=max| ^ 0 

[s=Lj+iieJ 

The dynamics of the process is then the following: at time t + 1, the probability of neuron 
discharges are independent conditionally on the whole past, i.e., we have 

P(Vi G = a, I Xt) = []P(Xi+i(z) = a, | Xt), 

i&I 

furthermore, the probability of having a discharge from neuron i G / at time t + 1 is given by 

F{Xt+i{i) = l\Xt) = ipi{Ut{i)). 

Note that although we define the chain depending on a great part of its past, the probabilities 
of discharge at time t + 1 can be calculated knowing only the potentials at time t and potentials 
at time t + 1 can be calculated knowing only the potentials at time t and the discharges at 
time t. 



2.2. Algorithms. We now present two different simple algorithms to simulate the discrete 
model from an initial state of potentials Uq. 


2.2.1. Single-step algorithm. The single-step algorithm consists of simulating the evolution of 
the process step-by-step. Given potentials Ut at time t, we sample |/| independent uniform 
random variables {Vt{i))i^i over [0,1) and let 


Xt+i{i) - 

Furthermore, we update the potentials by letting 


Ut+iit) 


•0, 

✓ x 

• 1 
max < 

ut{i) + yw^^iXt+i{j), 0 

1 

1 16/ J 


■iiXt+i{i) = 1; 
ifW+i(i) = 0; 


= (1 - Xt+i{i)) max 


Ut{i)+ yWj^iXt+i{j), 0 


j&i 


The simulation consists of repeating this process inductively from t = 0. 

Is easy to see that this simulation indeed produces the correct stochastic process. 


2.2.2. Multi-step algorithm. The multi-step algorithm consists of skipping steps of the single- 
step algorithm where no neuron discharges occur. To do this, we first observe that in the 
absecence of other neuron discharges, the time we have to wait from time to to see a discharge 
from neuron i has geometric distribution of parameter ipi{UtQ{i)). 

Given potentials Ut at time t, we sample |/| independent random variables (Tt(f))jg/ with Tt{i) 
having geometric distribution with parameter ipi{Ut{i)) for every i G I and let Tt = mm{Tt{i) : 
f G /} and Df = {i £ I : Tt{i) = Tt}. 

The variable Tt gives how much time we have to wait to see a neuron firing, so we skip this 
amount of time by letting Ut+s{i) = Ut{i) and Xt+s{i) = 0 for every 0 < s < T* and i £ I and 
then let 

Xt+Ttii) = 
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Furthermore, we update the potentials by letting 


Ut+Tt{'i) = ' 

'0, 

max < 

\ut{l) + Y,WJ^^Xt+TA3), o] 


1 1 

1 fe/ J 


ifXt+T*(i) = i; 
if Xt+Tt (i) = 0; 


= (1 - X4+rt(i))max 


Ui 


t * 


E' 

je/ 


+ > Wj^iXt+TtU)} 


Proposition 2.1. The multi-step algorithm correcly simulates the discrete time stochastic pro¬ 
cess. 


Proof. Throughout this proof, we denote the random variables produced by the single-step 
algorithm by X' and t/b 
For every time t, let 

Tl{i) = inf{s > t : X'(i) = 1}; 
r; = min{r/(z) : i G /}; 

D' = {iGl:XTiii) = l}. 

Note that it is enough to prove that the random variables (Tq, Dq) and (Tq, Dq) have the same 
law (because after times Tq and Tq, the algorithms depend only on Uto and U!p, respectively). 

Observe now that for every to > 0 and every Aq C I not-empty, we have that {Tq,D'q) = 
(to, ^o) if and only if 

X[{i) = 0, Vt G I,Vt < to; 

X;(t) = 0, yieI\Ao; 

xl^{i) = i, yiGAo-, 

hence we have 

to—1 

p((T',T')=(to,Ao))= n 

t=l i^I\A.Q ^GAq 

i&I\Ao *SAo 

because the potentials of the neurons remain the same if there is no neuron discharge. 
Therefore we have 

P((T',T') = (to,^o)) = n n = *o) 

i&I\Ao *SAo 

= P(Vt G I \ AQ,To{i) > to and Vi G AQ,To{i) = to) 

= IF’((2o, Do) = (to, vlo), 

because of the independence of the random variables (To(i))ig/. 

Thus we have proved that {Tq, Dq) and (To,T>o) have the same law. ■ 


3. Continuous time model 


We introduce now the continuous time stochastic process. The idea is to define the process 
from the multi-step algorithm presented in the previous section. 

We suppose that an initial potential {Uo{i))i^i is given. Naturally, the difference from this 
model to the last is that the chains (W)ieM+ and {Ut)t&R+ are now indexed by continuous time. 

Now we would like to add decay on the potentials of the neurons so we suppose that, for 
every i G /, we are given a function V): M+ x M_|_ — )■ M_|_ that will give how the potential of 
neuron i decays in the abscence of neuron discharges: the value Vi{u,s) will be how much 
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potential is left after a total time s has passed if the neuron started with potential u (naturally, 
we suppose Vi{u, 0) = u for every tt > 0). 

The dynamics of the process is then defined by the following evolution algorithm. 

Given potentials Ut at time t, we sample |/| independent random variables (Tt(i))jg/ with Tt{i) 
having a certain distribution (which will depend on the choice of Vi and which we will study 
later) for every i £ I and let Tt = min{Tt(i) : i £ 1} and Dt = {i £ I : Tt{i) = Tt}. 

Then we let Ut+sii) = Vi{Ut{i), s) and Xt+sii) = 0 for every 0 < s < and i £ I and let 


Furthermore, we update the potentials by letting 


Ut+Ttii) = < 

'0, 

max < 

\v{Utii),Tt) + Y,Wj^at+TM, o] 


1 1 

1 ie/ J 


if ^t+T*(i) 


if^t+T*(i) 


= (1 - Xt+Tt{i)) max 


ViiUt{i),Tt) + E MO-. 

i6/ 


^t+TtU), 0 


1 ; 

0 ; 


3.1. Distribution of wait time. In this section, we will study what kind of distribution we 
should put in the random variables Tt(iys. We assume that t and i are fixed, and we will 
denote Tt{i) by simply T until the end of this section (Section 3). 

In the multi-step algorithm of the discrete time model, this variable had geometric distribution 
with parameter A = ^p{U) (here we also are dropping the notation by letting ip = (pi and U = 
Ut{i)). This means that, for every k £ N*, we had 

p(r = k) = {i- x)^-^x = p(r < k)x, 


so the natural analogous distribution in continuous time is to consider a probability density 
function p satisfying 

p{t) = (l- p{s)ds^ X. 

Now we have that p must be a solution of the following differential equation 


p\t) = -Xp{t), 


hence it is of the form 


p(t) = Ce 


where C G M is a constant. 

Substituting back in the original equation, we have 

p{t) 

P{ti )Uf> = 1 — 

/O 
rO 


/ p{s)ds = 1 — 

Jo 


X 


= 1 - 


Ce 


—Xt 


X 


and, using the condition p{s)ds = 0, we deduce that C = A, hence we obtain the exponential 
distribution of parameter A, which was expected. 

But we are now interested in allowing the parameter A to vary in time. This means that p 
should satisfy 

t 


which leads to the following differential equation 

p'{t)X{t)-p{t)X'{t) 


p{t) = (^1- p{s)ds^ X{t), 
= pit), 


A2(t) 
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whose solutions are of the form 


p{t) = C\{t) exp J X{s)ds^ , 


where C G M is a constant. 

Substituting back in the original equation, we have 

p{s)ds = 1 - ^ = 1 - Cexp ^ \{s)ds^ , 

and again, using the condition p{s)ds, we deduce that (7 = 1. 

Note now that p{s)ds = 1 if and only if X{s)ds = +oo. The interpretation of this 
is that if X{t) decreases too fast, then there is a non-zero probability that the neuron will never 
fire. 

Now define the function 

F: [0,-hoo] — ^ [0,1] 


t 


/ p{s)ds, if t < -|-oo; 

Jo 

1 , if t = -|-oo; 


which is the analogous of a cumulative distribution function with the difference that the random 
variable can take the value -|-oo. 

Therefore, the distribution of T is given by 

'P(T < t) = F{t), Vt < -|-oo; 

P+OO 

p{s)ds. 


P(T = -|-oo) = F(-|-oo) — lim F{s) = 1 — [ 
' s^>-|-oo Jq 


Now we let X{t) = ip{V{t)) (again dropping the notation by letting F(s) = Vi{U{t),s)). 

In the next sections, we will study decay laws that satisfy the following differential equation 

V\t) = -pV'rit), 

where 7 ^ 1 is a fixed constant. 

Note that in this particular case we have 

f x(s),s = r ^ivis)),s = r «f(£),,. i 

Jo Jo Jo -ll.V-'(s) ,, Jy^,^ 

and limt^+oo V(t) = 0 . 




-dv. 


Furthermore, we are interested in the following potential probability functions 

(1) Exponential: = 1 — for /3 > 0 fixed; 

(2) Rational: ipJ'\u) = vX -|- /3), for r G N* and /? > 0 fixed; 

(3) Monomial: Priu) = jdvX, for r G N* and /? > 0 fixed; 


3.2. Exponential decay. In the case 7 = 1, we have the following differential equation 

V'{t) = -pV{t), 

whose solutions are of the form 

V{t) = E(0)e"^*, 

which is the exponential decay typical of radioactive decay models. 

Eor this type of decay, we can prove a very interesting property. 

Proposition 3.1. If g: M+ —)■ M+ is a continuous function with g{u) = 0 if and only if n = 0 
and continuously differentiable in a neighbourhood of 0 and r > 0 is a positive real number, 
then taking V{t) = E(0)e“^* and ip ^ g^ yields P(T = -|-oo) > 0. 


5 



Proof. Since g is continuously differentiable in a neighbourhood of 0 and g{0) = 0, for every e > 
0, there exists to > 0 such that 

9{t) ^ ig'{0) + e)t, 

for every 0 ^ t < to, hence 

^it)^{g\0)+eYf. 

This means that 

r i r 

Jo V Jo V 




= (g\0)+eY- 


to 


— ( 5 ^( 0 ) + e)^— < + 00 , 
r 


where the last two equalities follow from the fact that r > 0. 
Hence 

'■+“ 1 (p{v) 


T+OO 1 

/ X{s)ds = — 

Jo 9 Jo 


1 


Po 


V 




9 \Jo V 
< +00 


-dv 


dv + 


f.y(o) 


ip{v) 


dv 


ho 


and, therefore 


P(T < + 00 ) = 1 — exp J X{.s)ds^ < 1. 


Corollary 3.2. Suppose that, for every i £ I, we are given a positive real number r* > 0 and 
a function gi: M_|_ —)■ M_|_ such that gi{0) = 0 and such that gi is continuous and continuously 
differentiable in a neighbourhood of 0. 

Then the continuous time model with ipi = gt for every i £ I and exponential decay has 
non-null probability of never firing, i.e., we have 

P(Vt > 0,Vf G = 0) > 0. 

Remark. Clearly from the proof of Proposition 3.1, we only need Lipschitz condition on a 
neighbourhood of 0 and locally boundedness of g, but we chose not to state the proposition in 
the more general form for simplicity. 


3.2.1. Pratical sampling. Although the continuous time algorithm is well-defined, we are inter¬ 
ested in actually implementing it with a reasonable efficiency, so in this section we show how 
one can sample the random variable T of the algorithm from a uniform random variable Z 
over [0,1). 

For the case of the rational potential note that, for every t < -|-oo, we have 


Y 1 

/ X{s)ds = — 

Jo d Jvit) 




{r)(^ 


V 


dv 


V{t) 

V(0) 


V 

1 


dv 


_ 1 

9 Jv{t) + P 

_ 1 ln(u^ + /?) 

= ^ In + 1 _ In 

rg, ^VftY + jd rg ^ jd 
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Hence, for every t < +oo, we have 


F{t) = 1 — exp J X{s)ds 

_ f vior+(3 
+ /3 


" [v{ty + p) 

v{oY + 


1 


t —^~1“CXD 


1 - 




With a simple calculation, for every t < +oo, we have 


1 {v{Y + m-F{t)Y-Y 

rfi H(O)'' 


hence defining 
G: [0,1) 


[0, +oo] 

1 ^^(y( 0 )r-+^)(l_^)r-/._^ 


rn 

+ 00 , 


H( 0 )^ 




-l/(r/i) 


otherwise; 

we have P(G(Z) < t) = F{t) for every t < +oo and F{G{Z) < +oo) = hmt_^+oo P’(t), thus 
giving an easy way of sampling T from Z. 

Remark. Note that taking the limit V (0) —)• +oo, we have that G(^) = — ln(l —for every ^ G 
[0,1), this means that if H(0) is arbitrarily large, the wait time has exponential distribution 
with parameter 1 (^ = 1 — 

The case of the exponential potential also gives an invertible F{t), but the inverse 

cannot be expressed in terms of essential functions, which makes it very unpratical to compute. 

We will now consider the monomial potential (pr- Note that, for every t < +oo, we have 

-I p,r{v) 


[ \{s)ds = — 

Jo M 


-dv 


1 


v{t) V 

rV{0) 

I Y dv 
M Jv{t) 

f3{v{oY - v{tY) 


t —^~1“CXD 


rfi 

rpL 


Hence, for every t < +oo, we have 

F{t) = 1 — exp J X{s)ds ) = 1 — exp ( — 


Y{v{Y - VY 


rn 


= 1 — exp — 


/lH(0)"(l-e-^'-*)V^+oo 


rp, 

With a simple calculation, for every t < +oo, we have 


hence defining 

G: [0,1) 


1 — exp — 


Y V{Y 

rfj, 



if ^ < 1 — exp ( — 
otherwise; 


YV{Y 

rfj, 
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we have ¥{G{Z) < t) = F{t) for every t < +oo and ¥{G{Z) < +oo) = F{t), thus 

giving an easy way of sampling T from Z. 

Remark. Note that taking the limit 1^(0) —)• +oo, we have that G{^) = 0 for every ^ G [0, 1), 
this means that if V (0) is arbitrarily large, the neuron fires imediately. This behaviour is typical 
of potential functions such that lim^j-^+oo ‘p(u) = +oo. 


3 . 3 . Other decays. Now we will cover the case where V(t) satisfies the following differential 
equation 

v'(t) = -fiV(ty, 

with 7 > 1 a hxed constant. 

The solutions of this differential equation are of the form 

which in the particular case when 7 = 2 gives the reciprocal decay 

^ fit + V( 0 )-^' 

And in this cases we have a proposition analogous to Proposition 3 . 1 . 

Proposition 3.3. Suppose g: M+ —)• M+ is a continuous function vanishing only at 0 and of 
class Cl-7J on a neighbourhood of 0 and 

a»-"- 

for every /c = 0,1,..., [7J — 1. 

Then for every r > (7 — 1 )/ [7J, taking V(t) = + (7 — and ip = 

yields P(T = +00) > 0 . 

Proof. Note that [7J r — 7 + 1 > 0 . Since g is of class Cl-7J on a neighbourhood of 0 and all 
the [7J — 1 first derivatives of g are null on 0, we have that for every e > 0, there exists to > 0 
such that 

for every 0 < t < to, where is the [7j-th derivative of g. Hence we have 

^L 7 j»' 


(^(t)^(5(W)(0) + er 


L7jh 


This means that 


r < r 

/o VI Jo bJ 


c/(L7j)(o) + e^ 

1 " tL7j 

LtJ! J 


c/(L7J)(o) + £^ 

^ flip 

LtJ! I 

1 L^Jr’ 


^0 


where the last two equalities follow from the fact that [ 7 J r — 7 + 1 > 0 . 



Hence 


and, therefore 



X{s)ds 


1 

1 


Jo 


dv 



V>{v) 

v'f 


dv + 




< +00 


P(T < +oo) = 1 — exp 



< 1 . 


Corollary 3.4. Suppose that, for every i £ I, we are given a real number r* > (7 — 1)/ [ 7 J 
function gi: M+ —)■ such that gi is continuous and continuously differentiable [ 7 J times in a 

neighbourhood of 0 and the first [ 7 J — 1 derivatives of g and g itself are all null on 0 . 

Then the continuous time model with (pi = gi for every i £ I and decay with parameter 7 
has non-null probability of never firing, i.e., we have 

P(Vt > 0,Vi G = 0) > 0. 

Remark. Clearly from the proof of Proposition 3.3, we only need [ 7 J-Holder condition on a 
neighbourhood of 0 and locally boundedness of g, but again we chose not to state the proposition 
in the more general form for simplicity. 


3.3.1. Pratical sampling. Again we show that for some potentials we can sample the random 
variable T of the algorithm from a uniform random variable Z over [0,1). 

For simplicity, we will only show the cases with 7 = 2. 

For the rational potential with r = 1, note that, for every t < -|-oo, we have 

C 1 fVio) mWfv) 

/ X(s)ds = — - TT-^dv 

Jo M Jv{t) 

1 fViO) 

-dv 


d'Jvit) v{v + l3) 

1 ^f3-^ f3-^ 


d- Jv(t) 


V + (3 


V V + /3 

vio) 

v(t) 


dv 


1 F(0)(H(t) + /3)t^+po 

^V{t)iVi0) + /3) 


Hence, for every t < -|-oo, we have 
F{t) = 1 — exp (— 

= 1 - 


X J U(*)(r(0) + ^))J 


/'r(o)((nt + v'(o) 




/?) 


V(Mt + H(0)-i)-i(C(0)+/3) 
With a simple calculation, for every t < -|-oo, we have 

(1 - F{t))-^y -I f I 




t —^~1“CXD 


1 . 


t = 


H( 0 ) + /? 
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hence defining 


G: [0,1) 


[ 0 , +oo] 

/ 1 1 \ 

vno) /?; 


we have ¥{G{Z) < t) = F{t) for every t < +oo, thus giving an easy way of sampling T from Z. 


Remark. Note that in this case G ommits the value +oo, which means that the neuron will 
always fire in finite time. 

Note also that taking the limit F(0) —)• +oo, we have that G(^) = ((1 — — l)/(/3;u) for 

every ^ G [0,1). 


For the rational potential with r = 2, note that, for every t < +oo, we have 
rt 1 rV'(O) 


/ X{s)ds = - [ 

Jo Jv 


-dv 


v{t) V- 

V{0) ^ 


Jv(t) V^ + Id 


dv 


1 1 V 

-= arctan —= 

VP VP 


V{0) 


V(t) 


1 


VPiJ- V 

Hence, for every t < +oo, we have 

rt 


( V{0) V{t) 

arctan —;=— arctan 


VP 


VP 


t^+oo 1 H(0) 

' arctan 


VPfJ^ 


F{t) = 1 - exp X{s)ds^ = 1 - exp 


V{0) 

arctan ——— arctan 


VP ■ 

H(t) 


= 1 — exp — 


1 


VPfJ^ V 


f H(0) (pt + ViO) 

arctan —;=— arctan 


VP 

-1\-1 


VP 


)) 


t^+oo 


1 — exp — 


1 


arctan 


VP 

vm 


VP 


VPn VP 

Again with a simple calculation, for every t < +oo, we have 


hence defining 

G: [0,1) 




t i ^arctan + //Y^ln(l - F{t))^ 

—)■ [ 0 , +oo] 

M ^arctan + pVP ln(l - ^)^ ■ 

+ 00 , 


V{0) 


V{0) 


if c < L; 
otherwise; 


where 


L = 1 — exp ( — 


1 H(0)\ 

arctan —^ 

VPfi VP J 


we have P(G(Z) < t) = F{t) for every t < +oo and F{G{Z) < +oo) = F(t), thus 

giving an easy way of sampling T from Z. 

Remark. Note that taking the limit H(0) —)■ +oo, we have that 

fsiinl — n ^ / M \-n( ^ — G ^ 1 — evn f -^ 

GV) = { VPl^ 


^ta„(-Mv/ 5 ln(l- 0 ), iff < 1 -exp (-^); 


+ 00 , 


otherwise; 


for every ^ G [ 0 , 1 ), this means that even if H( 0 ) is arbitrarily large, there is a probability of at 
least exp(— 7 r/( 2 \/[d^)) that the neuron will not fire. 
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Now, for the monomial decay ipr with r = 1, for every t < +oo, we have 

ft 1 rV{0) 

’V{t) 


f xis)ds = - f 
Jo d' Jvi 


-dv 




1 


V(0) o 

^dv 
d- Jv{t) V 


^ V(t) 

t —^H~cxd 
—)• + 00 . 


Hence, for every t < +oo, we have 

F(t) = l-exp(-^A(,)*)=l-(^) 

With a simple calculation, for every t < +oo, we have 

(1 - - 1 




t = 


hence defining 


G: [0,1) 


dV{0) 

> [0, +oo] 

(1 _ 1 


^iV{0) 

we have ¥{G{Z) < t) = F{t) for every t < +oo, thus giving an easy way of sampling T from Z. 

Remark. Note that taking the limit H(0) —)■ +oo, we have that G(^) = 0, this means that 
if V (0) is arbitrarily large, the neuron fires imediately. 

Last, but not least, we consider the monomial potential (pr with r ^ 2. Note that, for 
every t < +oo, we have 

(pr{v) 


[ X{s)ds = - [ 

Jo d' Jv 


-dv 


1 


v{t) 

V{0) 

pv^-^dv 

d' Jv{t) 

U 

(r - l)fi 


(v(oy-^ - 


t —^~1“CXD 


+ 00 , 


which coincides with the case (pr-i with exponential decay (with a different /3). 

We hope that these examples were enough to illustrate that by changing the potential decay 
law and the potential probability functions we can obtain very distinct wait time distributions. 


4. Formalization 

We will now formalize the model. 

Suppose / is a finite set and {Vi)i^j G ^ and {ipi)i^i G ^ are families of 

functions such that 

1. For every u G M+ and every i G I, we have Vi{u, 0) = u; 

2. For every t G M+ and every i G /, the function Vi{- ,t) is non-decreasing; 

3. For every u G M+ and every i G I, the function Vi{u, ■ ) is non-increasing; 
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4. For every u G M+, every i G / and every t, t' G M+, we have 

V^{u,t + t') = Vi{Vi{u,t),t')- 

5. For every i £ I, the function ipi is non-decreasing; 

6. For every i £ I, the function ipioVi is Borel-measurable (on both coordinates); 

Suppose furthermore that Wi^j £ is a matrix of neuron influences and that 

is a family of independent identically distributed uniform random variables over [0,1). 

Suppose finally that (a(f))jg/ G M:(_ is a vector of initial potentials. 

We now dehne sequences {Tn{i))neN,i&ii {Xn{i))nen,i&i and (t/n(*))neN,ie/ of random variables 
inductively as follows. 

i. Let Uo{i) = a{i) for every i £ I; 

ii. For every n G N, let 

Tn{i) = sup |t G [0, -Foo) : 1 - exp J ipi{Vi{Un{i), s))dm{s)^ ^ Zi 

iii. For every n G N, let = min{T„(i) ; i G /}; 

If Tn = -Foo, let Um{i) = limt^+oo Vi{Unii),t), Tmii) = = +oo and Xm{i) = 0 for 

every i £ I and every m > n and stop the induction; 

iv. For every n G N, let Xn(i) = 

V. For every n G N, let 




Un+i{i) = - Xn{i)) < lim Vi{Un{i),t)-\-y^ Wj^iXn{j), 0 


t^Tn 


3^1 


Finally, define, for every n G N, define T)) = Yln&n'^n- 
Observation. The condition 

Vi{u, t + t') = Vi(Vi{u, t),t') 

might seem unnatural at first, but it is an underlying condition of the algorithm because it 
says that interrupting the potential evolution at any time t and restarting the evolution from 
the value Vi{u,t) yields the same result of not interrupting. Such interruptions are made in 
the algorithm whenever a neuron fires and this condition says that a neuron i will not change 
its evolution law only because another completely independent neuron j fired (by completely 
independent, we mean a neuron whose influence Wj^i is zero). 

Note that the values are completely irrelevant (they are included in the definition 

of the model for notational simplicity only), because if Xn{i) = 1, we have Un+i{i) = 0. 

Moreover, note that formally we can’t define random variables indexed by M+ in the general 
case because we might have limn^.+oo < +oo. 

Finally, note that we almost surely never have two neurons firing at the same time (i.e., we 
have Vn G N, ^n{i) ^ 1 almost surely). 

Below, we present a sufficient condition for having lim,i_5.+oo T)) = -|-oo. 

Lemma 4.1. If, for every i £ I, there exists L > 0 such that 

r^i 

sup / ipi{Vi{u, s))dm{s) < + 00 , 


«eiR+ Jo 


then lim, 


•n^+oo 


T' = -1-00. 


Proof. Note that the condition of the lemma implies that there is a constant £ > 0 such 
that P(Vi G I,Tn{i) > ti) > e for every n G N, hence, from the independence, it follows 
that this event occurs infinitely often in n G N almost surely. 

Therefore we have that Tn > £ infinitely often almost surely, hence lim„_^+oo 


• Tn = + 00 . 
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If we have lim„^_i_oo = +oo almost surely, then we can define further the following random 
variables. 

Let no = infln G N ; T' < + 00 } and T_i = 0. Furthermore let XLAi) = X^ii), for 
every i & I and every n G N with n < no; and Xt{i) = 0 for every t G M+ \ {T^ : n G N} 
and i G /. 

Finally, let = Vi{Un{i),t — T^_i) for every t G M+ such that T^_i <T^ with n G N 
and n ^ no- 

With these definitions (and under these hypothesis), we have stochastic processes 
and ([/OteRg on continuous time. 

We now present a sufficient condition for the finitude of no, which represents the existence of 
a last neuron discharge (i.e., the event sup{t G M+ : 3i G I,X^{i) = 1} < + 00 ). 

Lemma 4.2. If C > 0 is such that, for every u G M+ and every i G /, we have 

^+00 

/ (pi{Vi{u,s))dm{s) < C, 

Jo 

then no < +00 almost surely. 

Proof. It follows directly from the fact that 

P(3n G N, = + 00 ) = P(3n G N, Vi G I, Tn{i) = + 00 ) 

^ 1 - lim (1 - = 1 - 

n^oo 


Remark. Note that the condition of Lemma 4.2 implies the condition of Lemma 4.1. 

We now come round to the theorem that characterizes the system’s death in the case of 
non-negative influences. 

Theorem 4.3. Suppose Wi^j ^ 0 for every i,j G /, let D be the digraph over I such 
that A{D) = {ij : i j, Wi^j > 0} and let 5 C / be the set of neurons i ^ I such that 
for every u G M+, we have 

^+00 

/ ipi{Vi{u,t))dm{t) < -hoo, 

Jo 

and let i? = / \ 5. 

Suppose also that for every i £ I, we have a(i) > 0 (i.e., the initial potentials are positive) 
and (pi{u) = 0 if and only if n = 0 . 

Suppose finally that for every i G /, we have limi^_l_oo Fj(n, t) = 0 if and only if n = 0 
or limt_^+oo Vi{u',t) = 0 for every u' > u. 

Under these circumstances, we have that 

P(no < +00) > 0 

if and only if D[R] is a DAG (i.e., the digraph induced by the neurons in i? is a directed acyclic 
graph). 

Furthermore, if P(no < -|-oo) > 0, then P(no < -|-oo) = 1. 


Proof. Let’s hrst prove that, for every i G R, we have in fact 

/ -l-oo 

ipi{Vi{u,t))dm{t) = -hoo. 


for every u > 0 (not only for some u). 

We know that for such i £ R, there exists uq £ 


such that 



Pi{Vi{uo,t))dm{t) = -hoo, 
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which immediately gives the same for every u > uq since Vi is non-decreasing on the first 
coordinate and ipi is non-decreasing. 

Suppose now that u G M+ is such that 0 < tt < uq and 

j' + OO 

/ ipi{Vi{u,t))dm{t) < - 1 - 00 . 

Jo 

Since (pi only vanishes at 0, the finitude of this integral implies limj_^_i_oo t) = 0 and 
since u > 0, we have that limt_^+oo Vi{uo,t) = 0. 

This in particular means that there exists to > 0 such that Vi{uo, to) ^ u, hence, for every t G 
M+, we have 


Vi{u, t) ^ Vi{Vi{uo, to), t) = Vi{uo, to -F t), 

where the inequality follows from the fact that Vi is non-decreasing in the first coordinate. 


Therefore we have 
/■+00 


r»-l-00 
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(fi{Vi{u,t))dm{t) ^ / (pi{Vi{uo,to + t))dm{t) 


r*-l-00 


Pi{Vi{uo,t))dm{t) 


'to 


r+oo rto 

= / ipi{Vi{uo,t))dm{t) - / pi{Vi{uo,t))dm{t) 
Jo Jo 

= - 1 - 00 , 


where the last equality follows from the fact that the second integral on the left hand side is 
finite (because pi is non-decreasing, hence locally bounded). But this contradicts the choice 
of u. 

Therefore, for every i G R and every u > 0, we have 

H-OO 

Pi{Vi{u,t))dm{t) = -l-co. 

Note finally that this implies that, for every i G R and every t,u > 0, we have Vi{u,t) > 0 
(because Vi is non-increasing on the second coordinate and pi only vanishes at 0). 


Suppose now that F{no < -|-oo) > 0, and let’s prove that D[R] is a DAG. 

Suppose not, i.e., suppose that there are neurons ii,i 2 , ■ ■ ■ ,ik, ik+i G R with ii = and 
such that ijij+i G E{D) for every j G [k]. 

First, let’s prove by induction that for every n G N there exists j G [k] such that Un{ij) > 0 
almost surely. 

For n = 0, this follows immediately from the fact that a{i) > 0 for every i G I. 

Suppose then that n > 0 and that Un-i{ij) > 0. 

If Xn{ij) = 0, then we are done, because Un{ij) ^ Vi.{Un-i{ij),Tn) > 0 since all neuron 
influences are non-negative. 

Suppose then that Xn{ij) = 1, then we have Xn{ij+i) = 0 almost surely, hence Un{ij+i) ^ 

Therefore we have 


P(Vn G N, G [k], Un{ij) > 0) = 1. 


Now, let E denote the event {no < -|-oo} and let A denote the event {no < -|-oo;3i G 
R, Uno{i) > 0}. Note that, since ii,i 2 , ■ ■ ■ Ak G R, we know that P(yl \ E) = 1. 

On the other hand, for every i G R and every n G N, we have 

( r+oo 

-J pi{Vi{Un{i),t))dm{t) 
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hence F{Tn{i) < +oo | > 0 ) = 1 , because, for every m > 0 , we have 

H-CXD 

(pi{Vi{u,t))dm{t) = + 00 . 

Finally, we have 

0 = P(3i G R,Tno{i) < +oo | E) 

^ P(3i G R, TriQ (i) < +00 | A n Fl)P(yl | E) 

= I E), 

which is a contradiction. 

Therefore D[R] is a DAG. 

Suppose now that D[R] is a DAG and let’s prove that P(no < +oo) = 1 (note that we will 
already prove the final part of the theorem also). 

Suppose not, i.e., suppose the event no = +oo happens with positive probability. From now 
on, all calculations and statements will be conditioned on the event {no = +oo} and on the 
event that two neurons never fire at the same time (and this will be ommited from the notation). 

The idea is to prove first that there is a state of low potentials that is visited infinitely often. 
The second step is to prove that we see infinitely often a large sequence of discharges only from 
neurons of R after reaching a state of low potential. Finally, the third step is to prove that 
there cannot be such a large sequence of discharges only from neurons of R, which will be a 
contradiction. 

Before we start, let N = |/| and W = 

First step. 

For every j G [N] and every n G N with n ^ j — 1, let = {i G I : Un+i{i) ^ jW} and Ej^n 
denote the event 

^ j}. 

Let’s prove by induction on j that Ej^n happens infinitely often in n almost surely. 

For j = 1, note that, since no = +oo, for every n G N, there exists n ^ n and f G I such 
that Xn{i) = 1, hence Un+iii) = 0. Therefore Ei^n happens infinitely often in n almost surely. 

Suppose now that j G [N] \ {1} and that Ej^i^n happens infinitely often in n almost surely. 

Suppose that Ej^n does not happen infinitely often in n, then we must have that \ Ej^n 

happens infinitely often in n. 

On the other hand, note that if there exists zq G /\such that T„(fo) < 1 and T„(i) > 1 
for every i G then we have Un+i{i) ^ {j — 1)1T + W = jW for every i G U {zq}- 

This means that, for every rz G N, we have 

^{Ej^n+l I Ej-i^n \ Ej^n) 

^ P(3zo G / \ Aj_i^n,Tn{io) < 1; Vz G Aj_i^n,Tn{i) > 1 I Ej_i^n \ Ej^n) 

^ ^1 -^:^axexp j - l)W,t))dm{t)^'^ exp ipi{Vi{{j - l)W,t))dm{t) 

^ - maxexp j (pi{Vi{{j - l)W,t))dm{t)^'^ fjexp j (pi{Vi{{j - l)W,t))dm{t) 

Note that the last number is in (0,1) and is independent of n. Let C be this number. 
Since Ej^i^n \ Ej^n happens infinitely often in n, we have 

F{Ejn infinitely often in n) ^ 1 — lim (1 — C)"" = 1 , 
which is a contradiction. 

Therefore, for every j G [N], we have that Ej^n happens infinitely often in n almost surely. 

Second step. 
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Let M = 2l^l + 1 and for every n G N, let Bn = {i G I : Xn{i) = 1} (remember that we are 
conditioning on the event Vn G N, |-B„| = 1). 

Moreover, for every j G [M] and every n G N with n N -\- j — let Fj^n denote the event 

FN,n—j+l Ll {Vm, G [j 1], Bn—m+l F R}, 

and note that = Fj^n H {Bn+i C R}. 

Let’s prove by induction on j that Fj^n happens infinitely often in n almost surely. 

For J = 1, we have Fj^n = F'A'',n and we already know that E^^n happens infinitely often in n 
almost surely. 

Suppose now that j G [M] \ {1} and that happens infinitely often in n almost surely. 

Note first that, from the definition of Fj-i^n, we have 

P(Vi G I, Un+i{i) ^ {N + j)W I = 1. 

Note that, for every n G N, we have 

P(Vn G S,Tn{i) = +00 I Fj^i^n)) ^ (“ / iPi{Vi{{N + j)W,t))dm{t) 

i&s ^ \ JO 

Note also that right hand side does not depend on n and is a number in (0,1) (from the 
definition of S). Let K be this number. Since Fj-i^n happens infinitely often in n, we have 

P(Fj_i n n {Vn G S, Tnii) = +oo}) infinitely often in n) ^ 1 — lim (1 — K)"' = 1. 

Note now that 

P(r „+1 < +00 I Fj_i^n n {Vn G S,Tn{i) = +oo}) 

= P(3f G i?, r„+i(f) < +00 I {Vn G S,Tn{i) = +oo}) 

= ^{Fj^n I Rj-l,n n {Vn G S,Tn{i) = +oo}), 

and since no = +oo, we have that Fj^n happens inhnitely often in n almost surely. 

Therefore, for every j G [M], we have that Fj^n happens infinitely often in n almost surely. 

Third step. 

Now, let ii, ^ 2 ,..., ifc be a topological ordering of the vertices of D[R], i.e., be such that ijii G 
E{D) implies j < I (such an ordering always exists in a DAG and can be obtained, for instance, 
by repeatedly removing one vertex that has indegree 0). 

Now let -< be the strict lexicographic order induced by this order on the power set V{R) of R 
and, for every n G N, let Qn = {f G ii : C/„(f) = 0}. 

Note that, for every n G N, we have 

P(<3n+1 <Qn\Bn(lR) = l, 

because if Bn = {f} C R, then i G Qn+i \ Qn (because i must have a positive potential to 
fire) and the discharge of i only affects potentials of neurons after i in the topological ordering 
of D[R]. 

On the other hand, since \V{R)\ = 2^ = M — 1, we know that there cannot be M consecutive 
occurrences of Bn C R, because each occurrence take Qn to a strictly smaller Qn+i- But this is 
precisely the definition of FM,n, which we proved to happen infinitely often in n, so we have a 
contradiction and the proof is complete. ■ 

Observation. Note that the condition a(i) > 0 for every f G / is only important for the first 
part of the proof (which is expected, since a zero initial potential should work in the direction 
of yielding no < +oo). 

On the other hand, the condition that for every i G /, we have limt_^+oo hi(u, t) = 0 if and 
only if n = 0 or limt^+oo Vi{u',t) = 0 for every u' > u might seem artificial at first, but it 
prevents potential decays that present distint regimens; one that decays to zero and others that 
don’t. 
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One example of symptomatic potential decay is 

Vi{u, t) = {u- [iij )e“* + [itj , 

which goes to zero as t goes to +oo if w < 1, but presents a different behaviour for u ^ 1. 
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